Relative entropy is an exact measure of non-Gaussianity
نویسندگان
چکیده
منابع مشابه
An Entropy Measure of Non-Stationary Processes
Shannon’s source entropy formula is not appropriate to measure the uncertainty of non-stationary processes. In this paper, we propose a new entropy measure for non-stationary processes, which is greater than or equal to Shannon’s source entropy. The maximum entropy of the non-stationary process has been considered, and it can be used as a design guideline in cryptography.
متن کاملRelative entropy as a measure of diagnostic information.
Relative entropy is a concept within information theory that provides a measure of the distance between two probability distributions. The author proposes that the amount of information gained by performing a diagnostic test can be quantified by calculating the relative entropy between the posttest and pretest probability distributions. This statistic, in essence, quantifies the degree to which...
متن کاملRelative entropy as a measure of inhomogeneity in general relativity
We introduce the notion of relative volume entropy for two spacetimes with preferred compact spacelike foliations. This is accomplished by applying the notion of Kullback-Leibler divergence to the volume elements induced on spacelike slices. The resulting quantity gives a lower bound on the number of bits which are necessary to describe one metric given the other. For illustration, we study som...
متن کاملMimimal Relative Entropy Martingale Measure of Birth and Death Process
In this article, we investigate the MEMM (Minimal relative Entropy Martingale Measure) of Birth and Death processes and the MEMM of generalized Birth and Death processes. We see that the existence problem of the MEMM is reduced to the problem of solving the corresponding Hamilton-Jacobi-Bellman equation.
متن کاملLimitations of state estimation: absolute lower bound of minimum variance estimation/filtering, Gaussianity-whiteness measure (joint Shannon-Wiener entropy), and Gaussianing-whitening filter (maximum Gaussianity-whiteness measure principle)
This paper aims at obtaining performance limitations of state estimation in terms of variance minimization (minimum variance estimation and filtering) using information theory. Two new notions, negentropy rate and Gaussianity-whiteness measure (joint Shannon-Wiener entropy), are proposed to facilitate the analysis. Topics such as Gaussianing-whitening filter (the maximum Gaussianity-whiteness m...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Physical Review A
سال: 2013
ISSN: 1050-2947,1094-1622
DOI: 10.1103/physreva.88.012322